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The U.S. Government Accounting Office (GAO) evaluated 
how well divisions in the Departments of the Air Force, Army, and 
Navy and the Veterans Administration have implemented pertormance 
appraisal systems for blue-collar employees. The study found that in 
the four agencies visited, performance appraisal systems were in 
place; however, problems existed, particularly with performance 
standards. The GAO reviewed 84 performance plans applicable to 5,843 
employees at the locations visited and found that one or more of the 
standards in 54 of these plans were not clear, did not distinguish 
among all levels of performance, or were based on uncontrollable 
external factors. In addition, some of these standards were not used 
to measure performance and in some cases were inappropriately based 
on personal traits. To a lesser extent, problems were also noted in 
communicating standards to employees in a timely manner and providing 
employees with performance feedback. Although agencies have conducted 
evaluations of performance appraisal systems and have identified 
deficiencies, evaluations by local authorities, where closer contact 
with the work and the standards for performing the work exist, were 
generally not occurring. The GAO recommended that the Secretaries of 
the Air Force, Army, and Navy and the Administrator of Veterans 
Affairs ensure that local authorities conduct evaluations of 
performance appraisal systems and correct deficiencies. All of the 
agencies agreed with the findings and said they were planning 
activities to address the shortcomings identified in the report; 
however, specific plans were often lacking. (KC) 
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United States 

General Accounting Of Hce 

Washington, D.C. 20548 



General Government Division 

B-209522 

June 18, 1987 

The Honorable Edward C. Aldridge, Jr. 
The Secretary of the Air Force 

The Honorable John 0. Marsh, Jr, 
The Secretary of the Army 

The Honorable James H. V/ebb, Jr. 
The Secretary of the Navy 

The Honorable Thomas K. Tumage 
Administrator of Veterans Affairs 

This report evaluates how your agencies have implemented performance appraisal 
systems for Federal Wage Systera (blue-collar) employees. It is the latest in a series 
of reviews conducted in compliance with the requirements in the Civil Service 
Reform Act of 1978 that we review and report on the effectiveness of agencies* 
performance appraisal system operations. 

This report contains a recommendation to you on page 22. As you know, the head of 
a federal agency is to submit a written statement on actions taken on our 
recommendations to the Senate Committee on Governmental Affairs and the House 
Committee on Govemmexit Operations not later than 60 days after the date of the 
report and to the House and Senate Committees on Appropriations with the agency's 
first request for appropriations made more than 60 days after the date of the report 
as required by 31 U.S.C. 720. 

We are sending copies of this report to the Director, Office of Management and 
Budget; the Director, Office of Personnel Management; and other interested parties, 
including the congressional conunittees with jurisdiction over federal employee 
matters. 



William J. Anderson 
Assistant Comptroller General 
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Executive Summary 



The Civil Service Reform Act of 1978 requires federal agencies to 
develop and establish systems to appraise the job performance of their 
employees. The act also requires gao to review agencies' performance 
appraisal systems and report on the effectiveness of their operations. 

This report evaluates how well activities in the Departments of the Air 
Force, Army, and Navy, and the Veterans Administration have imple- 
mented performance appraisal systems for blue-collar employees. As of 
September 1986, approximately 450,000 of these employees worked for 
the government and about 80 percent were in the four agencies gao 
reviewed. 



Background when the Civil Service Reform Act was passed in October 1978, Con- 

^ gress envisioned that performance appraisals would provide employees 

useful feedback on how well they did their jobs in relation to manage- 
ment's expectations. Congress also expected that these appraisals would 
provide management with a reliable basis for making various personnel 
decisions, such as promotions, awards, reassignments, and removals. 



The Office of Personnel Management (opm) requires that agencies' sys- 
tems include work standards for measuring job performance, progress 
reviews during the appraisal period, and evaluations of job perform- 
ance. OPM also requires agencies to continuously review and assess the 
manner in which appraisal functions are carried out and to make 
improvements where needed. 



Results in Brief '^^^ agencies GAO visited have performance appraisal systems in place; 

however, problems existed, particularly with performance standards. 
Problems included standards which were not clearly stated, did not dis- 
tinguish among all levels of performance, or were based on uncontrol- 
lable external factors. 



PrinciDal FindinfiS Performance appraisal systems for federal white-collar employees have 

^ ^ been the subject of a number of reviews that identified problems with 

the adequacy of standards and the performance appraisal process. 
Dunng this review oi blue-collar appraisal systems, gao disco^'ered sim- 
ilar problems, gao reviewed 84 performance plans applicable to 5,843 
employees at the locations it visitec! and found that one or more of the 
standards in 54 of these plans were not clear, did not distinguish among 
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Executive Summary 



all levels of performance, or were based on uncontrollable external fac- 
tors. Also, some of these standards were not used to measure perform- 
ance and, in some cases, were inappropriately based on personal traits. 
(See p. 10.) 

To a lesser extent, problems were also noted in communicating stan- 
dards to employees in a timely manner and providing employees with 
performance feedback. (See p. 15.) 

OPM and the agencies have conducted evaluations of performance 
appraisal systems and have identified deficiencies. However, evalua- 
tions by local activities, where closer contact with the work and the 
standards for performing the work exist, were generally not occurring. 
One of the eight activities gag reviewed had initiated a formal review of 
performance standards. (See p. 20.) 



ReCOnunendation order to improve the manner in which agencies monitor performance 

appraisal systems and evaluate their effectiveness, gag recommends 
that the Secretaries of the Air Force, Army, and Navy, and the Adminis- 
trator of Veterans Affairs ensure that local activities conduct evalua- 
tions of performance appraisal systems and correct deficiencies. Such 
evaluations should pay particular attention to the types of deficiencies 
GAG found as well as those cited in other evaluations. (See p. 22.) 



ASenCV CoitUnentS agencies agreed with gag's findings and recommendation. They 

said they had completed or were planning various initiatives to address 
the shortcomings identified in the report. However, in their comments, 
DOD and, to a lesser degree, va were silent as to the specific actions they 
plan to take to ensure that local activities implement the prescribed poli- 
cies and procedures for evaluating performance appraisal systems so 
that deficiencies can be identified and corrected. (See p. 22.) 
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Chapter 1 



Introduction 



The Civil Service Reform Act of 1978 (5 U.S.C. 4302) requires federal 
agencies to develop and establish appraisal systems that provide 
employees with feedback on how well they carry out their job responsi- 
bilities in relation to management's expectations. The act gave agencies 
considerable latitude in designing such systems, requiring only that they 

• provide for periodically appraising the job performance of employees; 

• encourage employee participation in establishing performance stan- 
dards; and 

• use the results of performance appraisals as a basis for decisions on 
training, rewarding, reassigning, promoting, reducing in grade, retaining, 
and removing employees. 

The act directs the Office of Personnel Management (opm) to offer tech- 
nical assistance to agencies in developing performance appraisal sys- 
tems and to review the systems to determine whether they met 
statutory requirements. In addition to the requirements placed upon 
OPM, the act requires us to review, on a selected basis, the performance 
appraisal systems that the agencies established. This review — the latest 
in a series of reviews that we have conducted on appraisal systems for 
various groups of federal employees — assesses the performance 
appraisal systems for blue-collar employees covered by the Federal 
Wage System. A listing of prior reports we issued on performance 
appraisal systems is included in appendix I. 



The Federal Wage System is a classification and pay system for all 
employees in positions traditionally referred to as Wue-coUar, for which 
trade, craft, or laboring experience and laiowledge are the most impor- 
tant requirements. There are about 372 blue-collar occupations in the 
federal government. 

According to opm, approximately 450,000 blue-collar employees were 
included under the performance appraisal systems of the agencies cov- 
ered oy the Civil Service Reform Act as of September 1986. Their occu- 
pations include a variety of crafts and trades, such as mechanics, 
machinists, electricians, sheet metal workers, and painters. 



Description of the 
Federal Wage System 
and Employee 
Occupations 
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Our objective was to determine how well agencies have implemented 
performance appraisal systems for blue-collar employees. 

We did our work at four agencies — the Departments of the Air Force, 
Army, and Navy, and the Veterans Administration (va). According to 
OPM, as of September 1986, these four agencies employed approximately 
80 percent of the government's blue-collar employees. 

We conducted work at" each of the four agencies' headquarters in Wash- 
ington, D.C., and at the following eight field activities. 



Table 1.1: Field Activities Where GAO ■■■HlHHB^HIHHBHHHHHBIHHHHBHHMIIHBHi 

Conducted Audit Work Agency Activity Location 

Air Force Ogden Air Logistics Center 

Hill Air Force Base Ogden, Utah 

San Antonio Air Logistics Center 
Kelly Air Force Base San Antonio. Texas 

Army Letterkenny Arrny Depot Chambersburg, Pennsylvania 

Tooele Army Depot Tooele, Utah 

Navy Naval Air Rework Facility Norfolk. Virginia 

Naval Air Rework Facility Cherry Point. North Carolina 

Veterans 

Administration VA Medical Center Denver. Colorado 
VA Medical Center Richmond. Virginia 



Objective, Scope, and 
Methodology 



We interviewed officials who were responsible for implementing 
appraisal systems agency wide. Also, to obtain information on various 
aspects of agencies' appraisal systems from employees and supervisors, 
we contacted 319 employees and 118 supervisors at the eight field activ- 
ities we visited. These people were judgmentally chosen from various 
blue-collar occupational series at each location. For 312 of the 437 
employees and supervisors we contacted, we reviewed performance 
appraisal files. These files included employees' performance plans, 
which are documents identifying the work employees are expected to 
perform, and the appraisals they received. The 312 files were judg- 
mentally selected to provide a mix of blue-collar occupations at the eight 
activities we visited. 

To assess the extent to which performance standards met statutory and 
regulatory requirements, we analyzed the standards contained in 84 per- 
formance plans which were applicable to about 5,800 blue-collar 
employees. Table 1.2 shows a breakdown by agency of the number of 
employees covered by the performance plans we reviewed. 
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Table 1.2: Perfonniince Plans Analyzed ■■^^^^■^■^^■H^^^^Hl^^H^^^B^^MHHVim^^H 

at the Locations Visited Navy Army Air Force VA Total 

Performance plans 

reviewed 20 21 20 23 84 

Total personnel 

covered by plans 1.721 485 3,352 285 5.843 

Total blue-collar 
personnel at sites 

visited 4,372 5,503 16,242 709 26,826 



The objective of our analysis was to assess the quality of performance 
standards used at the eight field activities. We determined whether the 
standards in the 84 plans contained opm's characteristics of good per- 
formance standards as stated in Chapter 430 of the Federal Personnel 
Manual by assessing whether they 

• contained measures that specified how well the employee should per- 
form or how accurate performance must be; 

• contained measures stating the quantity of work to be accomplished; 

• indicated how soon or when tasks should be completed; and 

• differentiated between levels of performance, such as between out- 
standing and highly satisfactory (or next lowest level), between satisfac- 
tory and marginally satisfactory (or next lowest level), etc. 

Because we found it impractical to use random sampling techniques, the 
results of this work cannot be projected to the total imiverse of blue- 
collar employees and supervisors in the agencies or field locations vis- 
ited, nor can the results be projected govemmentwide. However, agency 
officials at the headquarters level said that the blue-collar performance 
appraisal systems at the eight activities we visited would provide a typ- 
ical representation of appraisal system oi)erations for blue-collar 
employees throughout each agency. Therefore, we believe our analyses 
provided us with an informed perspective on the performance appraisal 
process for federal blue-collar workers. 

Our review, which was conducted in accordance with generally accepted 
government auditing standards, took place during the period between 
March and December 1985. Agency comments received in April 1987 
indicated that the results of our work were still current. 
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The Mechanisms for Appraising Employee 
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Improvements Are Needed 



Performance appraisal systems for federal white-collar employees have 
been the subject of a number of reviews that identified problems with 
the adequacy of standards and the performance appraisal process. 
During this review of blue-collar appraisal systems, we diSi.overed sim- 
ilar problems. We found that some standards lacked quality in that they 
were not clear, did not distinguish among all levels of performance, or 
were based on uncontrollable external factors. Also, standards were not 
always used to measure performance and, in some cases, were inappro- 
priately based on personal rather than performance traits. We also 
found that procedures to provide employees with early notification of 
performance expectations and timely feedback of performance-related 
information were not always adhered to. 



The Federal Personnel Manual requires performance standards to be 
(1) clearly stated, (2) performance-related rather than trait-related, and 
(3) measurable. 

We analyzed the standards contained in 84 performance plans i riat were 
applicable to about 5,800 blue-collar employees at the locations we vis- 
ited. We found that one or more of the standards in 54 of these 84 plans 
were questionable because they either: 

did not clearly state expected job performance, 
were trait-related rather than performance-related, 
did not distinguish among levels of performance, or 
were based on uncontrollable external factors. 

Employees* appraisals were derived from a summary of the ratings they 
received on individual standards contained in their plans. Thus, one 
inadequate standard in a performance plan could affect the credibility 
of employees* performance appraisals. For this reason, we did not 
attempt to determine the total number of standards that were in need of 
improvement in the plans we reviewed. We believed that by showing the 
existence of inadequate standards, sufficient evidence was presented to 
demonstrate the need for improveraent in this area. 



Not All Standards Clearly The Federal Personnel Manual requires that performance standards 
Stated Expected Job cleariy state expected job performance. We found some standards which 

Performance ^^^^ ^^^^ requirement, as illustrated in the following examples. 



n 



The Quality of 
Standards Needs 
Improvement 



ERIC 



Page 10 



GAO/GGD^7-72 Blue<k)Uar Workere 



Chapter 2 

The Mechanisms for Appraising Employee 
Performance Are Generally In Place, but 
Improvements Are Needed 



A critical element^ for an electronics worker was to perform mainte- 
nance and repair of electronic components. The performance standard 
at the satisfactory level stated that all assignments will be completed 
within 92 to 97 percent of the established time standard. Since the time 
standard represents the time it should normally take to complete a job, 
the performance standard, as written, required that all assignments be 
completed in less than the normal time for the worker to receive a satis- 
factory rating. Because such a high level of performance would appear 
to warrant a rating above the satisfactory level, the standard was prob- 
ably intended to require that 92 to 97 percent, of all assignments be com- 
pleted within the established time standard. 

A critical element for a warehouse worker foreman dealt with supply 
management. The satisfactory standard was **receipts processed within 
established timeframes. No more than 2 to 4 completed per year.*' As 
written, this standard appears unrealistic in that the employee only 
needs to complete two to four receipts a year within established time 
frames in order to receive a satisfactory rating. It was probably 
intended to mean that the employee could not exceed four instances of 
missing the established timeframes for processing receipts. 

An electrician's critical element was performing journeyman electrical 
duties. The performance standard at the outstanding or highest level 
was **acceptable failures per year to perform work at journeyman 
level." The standard is incomplete in that it does not indicate the 
number of failures that are acceptable. 



Standards Were Not Always The Diag nostic Guide for Imp roving the Quality of Performance Ele- 
Performance-Related ments and Standards ^ emphasizes that hi or<er to have meaningful and 

measurable performance standards, they should be performance- 
related. Furthermore, the Federal Personnel Majinal states that the use 
of personal traits (e.g., attitude) as a means of assessing performance 

* A cntical element is a component of an employee's job of sufficient importance that performance 
below the mmimum standard (usually a standard written to describe satisfactory performance) 
requires remedial action and denial of a within-grade increase; it may be the basis for removmg or 
reducing the grade level of the employee. A noncntical element is also an important aspect of tiie 
employee's work but failure to achieve the minimum standard does not require remedial action. 

^The Guide was prepared in July 1982 by the Interagency Advisory Group (lAG) Subcommittee on 
Improving the Quality of Elements and Standards. The Subcommittee is part of the lAG Committee on 
Performance Appraisal, an OPM-sponsored group comprised of agency personnel directors, their rep- 
resentatives, and line managers, fo.med to provide a fonim for shanng information about perform- 
ance appraisal systems and techniques. 
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does not meet statutory requirements unless they are clearly perform- 
ance-relat'^d and can be documented and measured. The use of traits can 
make it difficult to separate the person from the job, which is a critical 
distinction in an objective performance appraisal system. 

We found standards that were based inappropriately on personal traits 
as shown in the following examples. 

The standard for a heavy mobile equipment mechanic: "No more than 1- 
2 occasions per year when ... a subjoumeyman has to be counselled for 
not functioning diligently, cooperatively, and communicating as a team 
member." It appears that a supervisor would find it difficult tc define or 
objectively measure performance using such traits as diligence, coopera- 
tiveness, and communication as a team member. 

The standard for a woodworker: **Employee should support community 
and organization sponsored events and special interest programs." The 
standard further stated that to meet this standard, the employee must 
either participate in such programs os the Combined Federal Campaign 
and blood drives, or at least not openly object to them. 

The woodworker also had the following standard: ''Attends all meetings 
as scheduled and reflects a positive organizational image at such 
meetings." 

The personal traits expected under these standards are not clearly per- 
formance-related, and it is not clear how a supervisor could measure job 
performance using them. 



Standards Did Not Always 
Distinguish Among All 
Levels of Performance 



According to Opm guidance, performance standards should be written to 
clearly distinguish among performance levels so that supervisors can 
determine whether an employee's performance exceeded, met, or did not 
meet the standard. Written standards are not required at all perform- 
ance levels. For example, an agency could write a standard for highly 
satisfactory but not for outstanding. However, in such situations, it 
should be clear when performance would exceed the standard for highly 
satisfactory so that it can be rated at the outstanding level. This same 
principle applies to oth^r performance levels used by the agency. 

We found standards that did not clearly distinguish among all levels of 
performance as shown in the following examples. 
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The standard for highly satisfactory performance specified for an elec- 
tronic measurement equipment mechanics foreman was as follows: 
"Scheduled work inducted into shop with no delay s." [Underscoring sup- 
plied.] The standard for the marginal level was ^Induction of incoming 
work into shop is delay ed." [Underscoring supplied.] The standards for 
other performance levels were not specified. As written, the two stan- 
dards do not allow for performance at the satisfactory or any other level 
because there is no performance level possible other than **delays" and 
**no delays." An official at this field activity said that the same stan- 
dards were included in the performance plans of all the activity's first- 
line supervisors. 

The standard for a pneumatic systems mechanic forem^Ji at the highly 
satisfactory level was **jobs completed with virtually no additional man- 
hours over that projected." The only other standard specified was for 
the marginal level of performance, and it was **jobs completed exceed 
manhours over that projected. ' These standards do not enable a rater to 
determine how performance at any other level could be achieved. 

A boiler plant equipment mechanic had standards written at two levels. 
The standard for the far exceeded level was **zero failures to perform 
necessary emergency repairs on the boiler plant and auxiliary equip- 
ment." The standard for the satisfactory performance level was **one 
failure to perform." As written, the performance level between these 
two levels (i.e., highly satisfactory) cannot be achieved. 



Standards Were Based on 
Uncontrollable External 
Factors 



According to the Guide, the ability to achieve each performance 
standard should be within the employee's control, and external factors 
should not affect the employee's ability to meet the standard. If they do, 
the employee's own performance cannot be accurately evaluated. 

We found standards for supervisors included in our analysis that con- 
tained external factors beyond the supervisor's control. Examples of 
such standards follow: 

Present performance awards to three or four employees. 
Recognize 50 to 55 percent of workforce for high achievement. 
Achieve a sick leave usage rate of 56 to 60 hours per employee by the 
end of the rating period. 

These standards demonstrate the problem of measuring performance 
using uncontrollable factors. In the first two examples, the stated 



ERIC 



14 



Page 13 



GAO/GGI>87-72 Blue<:ollar Workers 



Chapter 2 

The Mechanisms for Appraising Employee 
Performance Are Generally in Place, but 
Improvements Are Needei^ 



number of employees may not deserve awards or recognition for high 
achievement. Similarly, a supervisor has limited control over subordi- 
nates' sick leave usage. 



As discussed previously, the Federal Pei^sonnel Manual requires that 
performance standards be measurable. Furthermore, the Guide cautions 
that if performance cannot be accurately measured, the supervisor will 
be unable to make a true assessment of an employee's performance 
against established requirements. Accordingly, the Guide states that 
methods for monitoring and measuring standards should be practical in 
terms of cost, time, and availability of data. Further, the Guide suggests 
that if quantity or quality standards are expressed in percentage terms, 
there should be an accurate way to measure performance. 

In this regard, we noted that at three of the field activities we visited, 
standards contained percentages, but there was no system for accumu- 
lating the information needed to determine individual employees' per- 
formance. Agency personnel officials told us that performance 
standards may appear objective and quantifiable; however, adequate 
consideration may not have been given to identifying measurement 
methods. 

We discussed various methods of measuring employee performance 
against standards with 3S supervisors. The supervisors were judg- 
mentally selected to provide a mix of blue-collar occupations at the eight 
activities we visited. Of the 36 supervisors we interviewed, 

• 14 said they did not measure employees' performance against quantified 
standards when preparing performance appraisals, 

• 9 said they assessed performance by observation and other information, 

• 6 said they could use standards to measure performance only to a lim- 
ited extent, and 

• 7 said they measured performance by the standards in the performance 
plans and by observation. 

Reasons for performance measurement problems cited by the supervi- 
sors included: 

• Supervisors were responsible for appraising too many employees to be 
able to monitor performance for each employee. 

• Some activitywide standards we/e not useful because they were not 
tailored to specific shop conditions. 



Standards Were Not Always 
Used to Measure 
Performance 
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• It was difficult to determine which employees were lesponsible for 
errors. 

OPM guidance suggests that the adequacy and availability of systems to 
provide measurement data during standards development be considered 
in order to avoid standards which are not cost effective or impose an 
excessive administrative burden. It also states that standards should not 
contain numbers or percentages if a tracking system does not exist to 
provide measurement data. An opm official said that if resources are not 
committed to tracking performance and measuring it against the stan- 
dards, the standards are useless. 



Not All Employees 
Were Informed of Their 
Performance 
Expectations in a 
Timely Manner 



According to the Federal Personnel Manual , standards and elements 
should be discussed with the employee at the beginning of the appraisal 
period which usually lasts 1 year, and they should be in writing. The 
Federal Personnel Manual states that effective two-way conmiunication 
about a job before the appraisal period begins can provide the opportu- 
nity to identify and promptly resolve any misunderstandings between 
the supervisor and employee. Civilian personnel officials and supervi- 
sors we interviewed said that it is important to communicate standaids 
so that the employees know what is expected of them. 

Amy, Navy, Air Force, and va regulations address the issue of commu- 
nicating standards. Navy and va regulations say that employees will be 
informed of their standards before the beginning of the appraisal period. 
Army and Air Force regulations say that the standards will be communi- 
cated at the beginning of the appraisal period. 

Because there were no definitive criteria in the act or opm guidelines, for 
our review we considered 30 days after the beginning of the appraisal 
period to be a reasonable time in which to communicate standards to the 
employees. Based on our review of performance plans and appraisals 
where a determination could be made, 283 out of 287 employees were 
informed of their performance expectations. However, 85 were not 
informed within 30 days. Furthermore, 47 of the 85 employees received 
their standards over 90 days into the appraisal period. The performance 
plans and appraisal forms for 25 employees did not have the data 
needed to determine whether they were informed of their performance 
expectations. 

At one field activity, four employees filed grievances alleging that regu- 
lations and the labor management agreement were violated because they 
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had not been given the performance plan containing their standards. 
Union officials and a civilian personnel official told us about the fol- 
lowing two cases. 

• A grievance was filed by an employee because he had not received his 
standards. While investigating this complaint, officials found that the 
supervisor of this employee had not prepared performance plans for 19 
employees. Therefore, these 19 employees could not be appraised at the 
end of the normal cycle. Instead, they were appraised based on a subse- 
quent 120-day period after they were given their standards. 

• In another case, three employees filed grievances because a supervisor 
did not communicate steindards. When a personnel officer followed up 
on the complaints, he found that none of the supervisor's 13 subordi- 
nates had performance plans. 



According to the Federal Personnel Manual effective interim feedback 
is an important ingredient of a perfomance appraisal system. The final 
results of the appraisal are less likely to come as a surprise to the 
employee under these circumstances. Navy, Air Force, and Army regula- 
tions require that during the performance period, the supervisor hold at 
least one progress or midyear review with their subordinates. The va 
regulation states that supervisors should periodically discuss 
employees' performance. 

Our review of the appraisal files at the field activities we visited showed 
that midyear reviews were not always held. Of 312 employees 
examined, 215 received a review; however, 48 did not. We could not 
determine whether reviews took place for 43 employees and the 
remaining 6 were in situations which did not warrant reviews (e.g., 
recent promotions). At one field activity, eight employees filed griev- 
ances because midyear performance reviews were not conducted. 



Midyear Perf ormarice 
Feedback Was Not 
Always Given 



Although Performance 
Appraisals Were 
Usually Communicated 
in a Timely Manner, 
Some Were Not 



The Federal Personnel Manual states that appraisals should be commu- 
nicated in writing with employees promptly following the appraisal 
period. We found that neither the act nor the opm regulations specified 
what ''promptly** means; therefore, the agencies* policies varied on 
when employees should be given their appraisals. 

The Army regulation stated that appraisals should be discussed with 
employees and are to be submitted not later than 45 days following the 
end of the rating period. 
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• The Air Force regulation stated that the supervisor has 30 days to com- 
plete and sign the appraisal. 

• The VA regulation required that the appraisals be approved within a 
month after the end of the rating period. 

• The Navy regulation is silent as to when the appraisal should be com- 
pleted; however, the two Navy field activities we visited required that 
appraisals be discussed within a month after the end of the appraisal 
cycle. 

Our review of performance appraisals at the eight field activities 
showed that 240 of 312 appraisals were communicated within the a^^en- 
cies' established criteria for approval, communication, or completion of 
ratings, but 69 were not. We could not determine when the remaining 
three were communicated. Agency headquarters officials said that 
appraisals should be communicated promptly, because delays can affect 
personnel actions and reduce the value of feedback. 



An 0PM Study Also 
Found Problems With 
the Appraisal System 
for Blue-Collar 
Employees 



In July 1985, after we began our assignment on appraisal processes for 
blue-collar employees, opm*s Analysis and Evaluation Division began a 
review to collect basic information on the operation of the performance 
appraisal program and gain insight into population and performance 
rating distributions for blue-collar employees, opm visited five field 
activities, inoludi::^g one in each of the three military agencies, a va med- 
ical center, and a Defense Logistics Agency activity. According to opm, 
the five activities represented 2.6 percent of the blue-collar employee 
population. 



The results of the opm review were categorized into five general areas 
related to performance appraisals: (1) performance elements and stan- 
dards, (2) appraisals of employee performance, (3) links between per- 
formance appraisal and personnel actions, (4) program support and 
effectiveness, and (5) other program information, opm found several 
shortcomings with the appraisal system, including 

• problems with elements and standards, ranging from supervisors* 
resentment of having to develop elements and standards to the poor 
quality of the standards; 

• difficulties experienced by supervisors in appraising employee perform- 
ance, which was attributed to employees reporting to different supervi- 
sors for varying lengths of time and supervisors* inability to provide 
continuous supervision; 

• limited program evaluation by the agencies; 
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• lack of support from supervisors and employees for the performance 
appraisal program, including a noted resentment on the part of supervi- 
sors to implement the program's administrative requirements; and 

• a need for more training, particularly in the development of better ele- 
ments and standards. 

Among other things, opm's August 1985 report recommended that opm 
devote attention to helping agencies develop better elements and stan- 
dards. In a draft of this report, we said that an opm official informed us 
that as of September 1986, no action had been taken to implement the 
recommendations in the opm report. In commenting on our draft report, 
OPM said that various actions had been taken which opm considered ade- 
quate to meet the needs its August 1985 report identified. These actions 
are described on pages 23-24. 



CJonclusiOnS ^ system for appraising employee performance was in place at each 

agency we visited. However, improvements are needed in the quality of 
standards and in the timeliness with which employees are informed of 
their performance expectations and given their performance feedback. 

Although we recognize that the process of evaluating employee perform- 
ance is difficult and that the development of an appraisal system which 
provides perfect measures of such performance may not be achievable, 
we believe there is room for improvement. Additional discussion of how 
such improvements could be achieved is contained in chapter 3. 
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According to the Federal Personnel Manual one of the essential aspects 
of a performance appraisal system is a provision for its continuous 
review, assessment, and when needed, revision. The manual further 
states that these evaluations should determine whether the performance 
standards contain opm s prescribed characteristics of good standards. 

Each of the agencies we visited had regulations requiring local level 
activities to evaluate appraisal system operations. As a rule, however, 
evaluations were being done only by higher level offices as part of their 
overall reviews of civilian personnel management functions. These 
reviews, which included such areas as position management and classifi- 
cation and employee training and development, were being conducted 
about once every 4 to 6 years. 

Local personnel offices are in closer contact with their activities* work 
and have the opportunity for conducting more frequent reviews of per- 
formance standards and implementing corrective actions. However, at 
the local activities we visited, such reviews were generally not 
occurring. 



Most of the Local 
Activities We Visited 
Were Not Assessing 
Their Performance 
Standards 



Five of the eight local activities we visited had been included in reviews 
of appraisal systems conducted by agency personnel management 
groups, and some of these reviews disclosed problems with performance 
standards. However, at the local level, only one of the eight activities 
had initiated a formal review of performance standards. 



Air Force March 1985, the Air Force Civilian Personnel Management Center 

conducted an evaluation at Hill Air Force Base, Utah, that included the 
Air Force Logistics Center. The study concluded that nearly half of the 
51 performance plans reviewed were deficient in preparation or content. 
The study also found that some standards were not clearly defined or 
measurable. As a result of its work, the Management Center recom- 
mended that Hill Air Force Base establish quality review committees to 
review all performance plans and assure their adequacy. A civilian per- 
sonnel official at Hill said that no one had followed up to ensure that the 
Management Center*s recommendations were implemented. 
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According to a Management Center official the M.jiagement Center had 
not done an evaluation at Kelly Air Force Base, Texas. Similarly, 
according to a Kelly personnel official, no formal studies have been 
made by the local personnel office. 



Army According to a Center official, the Army Civilian Personnel Center con- 

ducted reviews at Tooele Army Depot, Utah, in August 1982 and Sep- 
tember 1983. As a result of its first review, the Center reported that 
performance standards needed improvement. The report noted that 
there were far too many absolute standards when a range of perform- 
ance would be preferred. The report also stated that supervisors were 
not supportive of the performance appraisal system. Some supervisors 
believed it was too difficult and time consuming to evaluate employees 
against many of the standards, and that some of the necessary measure- 
ment tools did not exist. The second report said that the standards were 
better but recommended that further improvements be made. Tooele 
civilian personnel officials said they formally reviewed standards in the 
past but that they no longer do so. They said, however, that when they 
learn of a problem with a standard, they inform the supervisors through 
a civilian personnel quarterly report. 

According to a Center official, the Letterkenny Army Depot, Penn- 
sylvania, has not been reviewed by the Personnel Center since a new 
appraisal system became effective in October 1981. However, Let- 
terkenny pei*sonnel office staff undertook a 2-year study of all perform- 
ance standards in October 1984. The study identified a number of 
deficiencies relating to the quality of standards, including standards 
which relate to conduct rather than performance, standards which were 
difficult to track and measure, and standards which could not be 
exceeded. According to a civilian personnel official, the study resulted in 
certain standards and elements being rewritten. 



Navy The Navy Office of Civilian Personnel Management reviewed the Nor- 

folk and Cherry Point Naval Air Rework Facilities in 1985 before the 
completion of our work. Although we found problems of the type dis- 
cussed in the previous chapter, the Navy reviews did not disclose any 
such deficiencies. According to a Norfolk civilian personnel official, the 
personnel office does not have the resources to review performance 
standards on a regular basis. A Cherry Point civilian personnel official 
said that the standards were reviewed when they were first written, and 
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any revisions will be reviewed, but no other performance appraisal 
system evaluations are conducted. 



Veterans Administration The va Personnel Management Evaluation Division did a review of the 

vA Medical Center in Denver, Colorado, in August 1982. At that time, 
va's report stated that appraisal activities were being appropriately car- 
ried out. The Evaluation Division has not performed a review at the va 
Medical Center in Richmond, Virginia, since a new appraisal system was 
implemented in 1981. Personnel officials at both Denver and Richmond 
have done little in the way of reviews of the performance standards. At 
Denver, they said that they did not feel qualified to assess standards, 
but A^ould provide support if assistance was requested. The Richmond 
personnel officer said they do not have the resources to review the con- 
tent of all performance standards. 



Ck)nclusions 



Local activity personnel offices are in the best position to monitor their 
performance appraisal systems and effect improvements, but they have 
not taken an active role in helping to carry out this function. As a result, 
evaluations of performance appraisal systems have been sporadic, 
occurring only about once every 4 to 6 years. 



Recommendation 



We recommend that the Secretaries of Air Force, Army, and Navy and 
the Administrator of Veterans Affairs ensure that local activities con- 
duct evaluations of performance appraisal systems and correct deficien- 
cies. Such evaluations should pay particular attention to the types of 
deficiencies we found as well as those cited in other evaluations that 
have been performed. 



AfienCV Comments and March 1987, we provided draft copies of this report to dod and va to 
^ . obtain their comments on our findings and recommendation. Because 

Uur JCi valuation opm is responsible for assisting agencies in developing their performance 

appraisal systems and reviewing the systems in operation, we also sent 
a draft of the report to opm for its review and comment. 

In their comments, dod, va, and opm agreed that problems exist with the 
performance appraisal systems for blue-collar employees and discussed 
various actions they had taken or planned ♦^^o take to address the short- 
comings we found. 
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DOD and VA cited internal policies that require local activities to conduct 
evaluations of performance appraisal systems, dod also pointed out that, 
in September 1987, the Navy plans to release a revision of its current 
policy which is expected to further emphasize the importance of local 
evaluations as we recommended. 

VA agreed that local personnel offices are in the best position to conduct 
meaningful performance appraisal system reviews. The agency further 
said that appropriate steps would be taken to emphasize local facilities* 
responsibilities for reviewing and evaluating their performance 
appraisal practices and procedures. According to va, (1) the conduct of 
local personnel management evaluations will continue to be reviewed in 
agency-level personnel management evaluations, and (2) the importance 
of performance standards will continue to be emphasized through an 
existing training course. 

VA also described actions it had taken to improve the quality of perform- 
ance standards: (1) the development of a training module for supervi- 
sors on writing better standards; (2) the revision of va's performance 
appraisal policy to require the development of standards only at the 
fully successful level which is expected to simplify the process and con- 
tribute to the development of better standards; (3) the presentation of a 
2-1/2 day course on performance management for va personnel special- 
ists, given in 1986 and scheduled again for July 1987; and (4) a message 
to key officials on performance management. 

In its comments on the report, opm also fully supported the need for 
more evaluations by local activities, opm acknowledged that centralized 
leadership — both from opm as well as agencies* headquarters — is essen- 
tial to the performance appraisal process, but it is only at the local 
levels, where supervisors and employees interact daily, that changes can 
be made. 

OPM also said that the problems we found regarding the quality of stan- 
dards, timely communication with employees about performance expec- 
tations, midterm progress reviews, and communication of performance 
appraisals were significant, opm described the actions it has taken to 
assist agencies in correcting these problems. The actions included (1) the 
January 1986 distribution of several OPM-produced booklets to agency 
heads and personnel directors, two of which relate to the problems of 
developing adequate standards and communicating with employees; and 
(2) the development and approval of new performance appraisal plans 
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based on opm's March 1986 publication of revised performance manage- 
ment regulations. The regulations and plans call for greater employee 
participation in developing elements and standards, provide for the 
conmiunication of written performance plans to employees at the begin- 
ning of each appraisal period, and require that written ratings be given 
to employees as soon as possible after the end of the appraisal period. 

We believe the actions described above enhance the framework within 
which agencies can make changes to improve various aspects of the per- 
formance appraisal process, particularly in the area of performance 
standards. However, in their comments, dod and, to a lesser degree, va 
were silent as to the specific actions they plan to take to ensure that 
local activities implement the prescribed policies and procedures for 
evaluating performance appraisal systems so that deficiencies can be 
identified and corrected. To better ensure that the performance 
appraisal process is functioning as objectively and effectively as pos- 
sible, local activities must maintain constant vigilance to identify and 
correct weaknesses and headquarters must actively monitor the local 
activities' actions. 
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Listing of Prior GAO Reports on Performance 
Appraisal Systems 



Report mia and number 



New Performance Appraisals Beneficial But 
Refinements Needed (GAO/GGD-8372) 



Employees covered in 
Essuedate report 



A 2-Year Appraisal of Merit Pay in Three Agencies 
(GAO/GGD-84-1) 



9/15/83 General Schedule 



An Assessment of SES Performance Appraisal 
Systems (GAO/GGD-84-16) 



3/26/84 Merit pay 



5/16/84 Senior Executive Service 
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Note* GAG comments 
supplementing those in the 
report text appear at the 
end of this appendix. 




ASSISTANT SECRETARY OF DEFENSE 



WASHINGTON. D C 20301-4000 



FORCE MANAGEMENT 
AND PERSONNEL 



Z 1 APR 1387 



Mr. Frank C. Conahan 
Assistant Comptroller General 
National Security and International 

Affairs Division 
U.S. General Accounting Office 
Washington, DC 20548 

Dear Mr. Conahan: 

This is the Department of Defense (DoD) response to the 
General Accounting Office (GAO) Draft Report, "BLUE-COLLAR 
WORKERS: Appraisal Systems Are In Place But Basic Refinements 
Are Needed," Dated March 2, 1987 <GA0 Code 966191), OSD Case 
7240. 

The report findings acknowledge that performance appraisal 
systems are in place and note that improvements can oe made in 
their operation, particularly witn respect to the quality and 
clarity of performance standards. The report also acknowledges 
that agency level evaluations of performance appraisal systems 
generally are consistent with the GAG findings. it recommends 
that local activities give greater emphasis to evaluating 
performance appraisal systems and to their improvement. 

The report is helpful in that it confirms DoD Component 
internal evaluation findings and provides additional emphasis to 
improving the operation of performance appraisal systems that 
apply to the blue-collar work force. The DoD agrees with the 
recommendation that local activities must continually review 
their systems and correct deficiencies that ere found. Local 
activities are in tne best position to review performance 
standards and other features on a regular basis C4nd improve tnem 
through a continuing process ot consultation with supervisors and 
discussion during on-site supervisor training programs. it would 
have been helpful to have a more definitive analysis of findings 
by Agency. The GAO representatives have told us, however, that 
there were no important distinctions in this regard, indicating 
that problems identified are primarily systemic in nature rather 
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than attributable to inadequate implementation or management 
attention . 

Detailed responses to the draft report findings and 
recommendation are enclose'^. The opportunity to review the draft 
report and provide these cotuments is appreciated. 



Sincerely, 



Enclosure: 
As Stated 




ERiC 



Page 28 



27 



GAO/GGD^7.72 Blue^^oUar Workere 



Appendix n 

Comments From the Department of Defense 



GAO DRAFT REPORT - DATED MARCH 2, 1987 
(GAO CODE 966191) OSD CASE 7240 

"BLUE-COLLAR WORKERS: APPRAISAL SYSTEMS ARE IN PLACE, BUT 
BASIC R£PINEK:3ITS are NEEDED" 



• FINDING A ; Description Of The Federal Wage Systsm And 
Eaployee Occupations , The GAO reported that the Civil 
Service Reform Act of 1978 ("Act") required Federal Agencies 
^o develop and establish systems to appraise the job 
performance of their employees, and also required the GAO to 
review agencies performance appraisal systems and report on 
the effectiveness of their operations. The GAO noted that 
the Act gave agencies considerable latitude in designing 
such systems, requiring only that they 

- provide for periodically appraising the job performance 
of employees ; 

encourage employee participation in establishing 
performance standards; and 

use the results of performance appraisals as a basis for 
decisions on training, rewarding, reassigning, promoting, 
reducing in grade, retaining, and removing employees^ 

The GAO noted that, in addittion, the Act directed the Office 
of Personnel Management (0PM) to continously review and 
assess the manner in which appraisal functions are carried 
out and to make improvements where needed. The GAO noted 
that the Federal Wage System is a classification and pay 
system for all employees in positions traditionally referred 
to as blue-collar, for which trade, craft, or laboring 
experience and knowledge are the most important 
requirements. The GAO reported that there are about 372 
blue-collar occupations in the Federal Government, and 
approximately 450,000 blue-collar employees as of 
September 1986. (p. 1, pp. 7-8/GAO Draft Report) 

POD RESPONSE; Concur. 



DEPARTMENT OF DEFENSE COMMENTS 



* « * * * 



FINDINGS 



Enclosure 



ERIC 



Page 29 




GAO/GGD^7.72 Blue^Uar Workers 



Appendix U 

Comments From the Department of Defense 



2 



Now on pp. 10-15 



See comment 1 



FINDING B ; The Quality Standards Need laproveaent . The GAO 

reported that the Federal Personnel Manual requires 
performance standards to be (1) clearly stated, (2) 
performance-related rather than trait-related, and (3) 
measurable. The GAO found, however, that the standards 
contained in 84 performance plans applicable to about 5,800 
blue-collar employees at the locations it visited were 
questionable in 54 of these 84 plans because they either: 

did not clearly state expected job performance; 

were trait-related rather than performance-related; 

did not distinguish among levels of performance; or 

were based on uncontrollable external factors. 

The GAO also found that standards were not always used to 
measure performance and, in some cases, were inappropriately 
based on personal rather than performance traits. (p. 3, 
pp. 12-30/GAO Draft Report) 

POD RjSSPONSE ; Concur. The Department would like to point 
out, however, that the finding, which is based on a 
judgemental sample, includes performance plans for VA 
employees and, therefore, may not be representative of the 
DoD. 

FINDING C ; Not All Eaplovees Were Inforaed Of Their 
Performance Kipectations in A Tiaely Manner . The GAO 

reported that the Federal Personnel Manual indicates that 
(1) standards and elements should be discussed with the 
employee at the beginning of the appraisal period which 
usually lasts one year, (2) they should be in writing, and 
(3) states that effective two-way communication about a job 
before the appraisal period begins can provide the 
opportunity to identify and promptly resolve any 
misunderstandings between the supervisor and employee. The 
GAO found, however, that procedures to provide employees 
with early notification of performance expectations and 
timely feedback of performance-related information were not 
always adhered to. The GAO concluded that because no 
definitive timeliness criteria is mentioned in the Act or 
0PM guidelines, the GAO considered 30 days after the 
beginning of the appraisal period to be a reasonable time in 
which to communiate standards to employees. The GAO found 
that based on its criteria, 283 out of 287 employees were 
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Now on pp. 15-16. 



See comment 2. 



Now on p. 16 



informed of their performance expectations. Only 85 were 
not informed within 30 days; 47 of the 85 received their 
standards over 90 days into the appraisal. period. In 25 
cases data were not available to determine whether they were 
informed of their performance expectati'or>s . (p. 3, pp. 12- 
21/GAO Draft Report) 



DOD RESPONSE ; 

employees had 
expectations, 
is considered 
acceptable re 
employees are 
assigned. A 
recommended, 
guidelines ar 
0PM. 



Concur. The report specifies that 283 of 287 
been informed of their performance 
This represents nearly 99% of the sample and 
to be quite good. Frequently, there are 
asons for delaying this process, e.g., when new 

appointed or when a new supervisor is 
uniform time standard, therefore, is not 

If it is the GAG position that uniform 
e needed the issue should be referred to the 



FINDING D ; Midyear Performance Feedback Was Not Always 
Given > The GAG reported the Federal Personnel Manual 
indicates that effective interim feedback is an important 
ingredient of a performance appraisal system. The GAG 
found, however, that at some field activities midpoint 
reviews were not held. The GAG observed, for example, that 
of the 312 employees it examined, 215 received a midpoint 
review; however, 48 did not. The GAG could not determine 
whether reviews took place for 43 employees, and the 
remaining 6 were in situations that did not warrant reviews 
(e.g., recent promotions). (P. 3, pp. 22-23/GAG Draft 
Report ) 

DOD RESPONSE ; Concur. 

FINDING E s Although Perforaance Appraisals Were Usually 
CoMMunicated In A Tiitely Manner, £'0»c Were Not" The GAG 

reported that the Federal Personntil Manual states that 
appraisals should be communicated in writing with employees 
promptly following the appraisal period. The GAG found that 
neither the Act nor the GPM regulations specified what 
"promptly" means; therefore, the agencies' policies varied 
on when employees should be given their appraisals. The GAG 
reported, for example, that: 

^he Army regulation states that appraisals should be 
discussed with employees and are to be submitted not 
later than 45 days following the end of the rating 
per iod; 
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Now on pp. 16-17. 



See comment 3. 



the Air Force rcaulation states that the supervisor has 
30 days to complete and sign the appraisal; and 

- The Navy regulation is silent as to when the appraisal 
should be completed. 

The GAO concluded that of the 312 appraisals it evaluated, 
240 appraisals were communicated within the agencies' 
established criteria for approval, communication, or 
completion of ratings, but 69 were not and 3 could not be 
determined. (pp. 23-24/GAO Draft Report) 

POD RESPONSE ; Concur. It should be noted that the 0PM 
regulations are flexible on this issue and that the current 
Service guidelines are considered by the Department to be 
adequate. 

FINDING F ; An 0PM Study Also Found Probleas With The 
Appraisal Systea For Blue-Collar Eaployees * The GAO 

observed that in July 1985, the 0PM also conducted a study 
on the operation of the performance appraisal program to 
gain insight into population and performance rating 
distributions for blue-collar employees. The GAO noted that 
the results of the 0PM study were categorized into five 
general areas related to performance rating distributions 
for blue-collar employees, including (1) performance 
elements and standards, (2) appraisals of employee 
performance, (3) links between performance appraisal and 
personnel actions, (4) program support and effectiveness, 
and (5) other program information. The GAO reported that 
the OPM study found several shortcomings with the appraisal 
system, including: 

problems with elements and standards, ranging from 
supervisors' resentment of having to develop elements and 
standards to the poor quality of the standards; 

- difficulties experienced by supervisors in appraising 
employee performance, which was attributed to employees 
reporting to different supervisors for varying lengths of 
time and supervisors* inability to provide continuous 
supervision; 

limited program evaluation by the agencies; 

lack of support from supervisors and employees for the 
performance appraisal program, including a noted 
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Now on pp. 17-18. 



resentment on the part of supervisors to implement the 
program ' s administrative requirements ; and 

- a need for more training, particularly in the development 
of better elements and standards. 

The GAO observed that the 0PM study recommended that the 0PM 
devote attention to helping agencies develop better elements 
and standards, but as of September 1986, no action had been 
undertaken by the 0PM to implement the recommendations, 
(pp. 24-25/GAO Draft Report) 

POD RESPONSE ; Concur. The DoD acknowledges the findings of 
the 0PM study and notes that they are consistent with the 
GAO study. 

FINDING G s Most Of The Local Activities GAO Visited Were 
Not Assessing~Their Per£or«ance Standards > The GAO found 
that five of the eight local activities it visited had been 
included in reviews of appraisal systems conducted by agency 
personnel management groups, and some of these reviews 
disclosed problems with performance standards. The GAO 
found, however, that at the local level, only one of the 
eight activities had initiated a formal review of 
performance standards. The GAO reported the following 
results of specific Service reviews of appraisal systems: 

- Air Force . In March 1985, the Air B'orce Civilian 
Personnel Management Center conducted an evaluation at 
Hill Air Force Base, which included the Air Force 
Logistics Center. The study concluded that nearly half 
of the 51 performance plans reviewed were deficient in 
preparation or content. The Air Force study also found 
that some standards were not clearly defined or 
measurable. As a result of its work, the Management 
Center recommended that Hill Air Force Base establish 
quality review committees to review all performance plans 
and assure their adequacy. The GAO found, however, that 
according to a civilian personnel official at f ill 
informed, no one had followed up to ensure that the 
Management Center's recommendations were implemented. 

Army . According to a Center official, the Army Civilian 
Personnel Center conducted reviews at Tooele Army Depot 
in August 1982 and September 1983. As a result of its 
first review, the Center found that performance standards 
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needed iraproveraent . The report observed that- t-here were 
far too many absolute standards, when a range of 
performance would be preferred. The report also st-at-ed 
that supervisors were not supportive of the performance 
appraisal system — i.e., that some supervisors believed it 
was too difficult and time consuming to evaluate 
employees against many of the standards, and that some of 
the necessary measurement tools did not exist. The 
second report found that the standards were better, but 
recommended that further improvements be made. Tooele 
civilian personnel officials advised the GAO that they 
formally reviewed standards in the past, but that they no 
Iciiger do so. They stated, however, that when they learn 
of a problem with a standard, they inform the supervisors 
through a civilian personnel quarterly report. 

Navy . The Navy Office of Civilian Personnel Management 



reviewed the Norfolk and Cherry Point Naval Air Rework 
Facilities in 1985 before the completion of the GAO work. 
Although, the GAO found problems of the type discussed in 
the previous findings, the Navy reviews did not disclose 
any such deficiencies. The GAO reported that, according 
to a Navy official, the Norfolk personnel office does not 
have the resources to review performance standards on a 
regular basis. (pp. 28-29/GAO Draft Report) 

POD RESPOHSE : Concur. It should be noted that personnel 
management evaluations conducted by Service Headquarters 
concentrate their follow-up activities on fundamental merit 
system improprieties such as incorrect appointment or 
position classification actions. Other matters, such as 
performance systems involving judgement or improvement of 
systems that are operating in a generally acceptable ways 
normally are reviewed during the next regular scheduled 
evaluations. The Navy evaluation at Norfolk and Cherry 
Point, for example, failed to disclose any of the 
deficiencies found there by the GAO. Navy evaluation 
officials report that these evaluations included a review of 
performance appraisals and attribute the difference to the 
possible use of different evaluation criteria or to the 
selection of a different sample, in terms of size or 



m RECOMMENDATION ; The GAO recommended that the Secretaries 
of Air Force, Army and Navy ensure that local activities 
conduct evaluations of performance appraisal systems and 



See comment 4 



composition. 



RECOMMENDATION 
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Now on p 22. 



Discussed on pp, 22-23 



correct deficiencies. (The GAO observed that such 
evaluations should pay particular attention to the types of 
deficiencies GAO found as well as those cited in other 
evaluations that have been performed.) (pp. 3-4, p. 30/GAO 
Draft Report) 

DOD RI^SPOKSE: Concur. Army and Air Force policies (DA 
Regulation 690-400, Chapter 430, and AF Regulation 40-452) 
currently require local activities to conduct performance 
appraisal evaluation. The Navy regulation (CPI 430) 
contains detailed guidelines for activities to follov; and a 
revision to this policy, planned for release in September 
1987, is expected to provide further emphasis on local 
evaluation as GAO recommends. 
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The following are gao's comments on the Department of Defense's letter 
dated April 21, 1987. 



C AO Commpnt^ ^ • ^^^^ officials to discuss the comments on the draft report. 

KJJWJ KjUiiii ciiib informed them that about 75 percent of the questionable perform- 

ance plans were applicable to dod employees. 

2. We agree that in certain circumstances, such as the ones dod 
described, flexibility in providing employees their performance expecta- 
tions can be appropriate. In pointing out delays in the process, we did 
not suggest that a uniform time period in which all employees must 
receive their expectations was necessary, regardless of the circum- 
stances. No definitive govemmentwide criteria exists on when 
employees should receive their expectations, only cpm's requirement 
that this practice be done in a * timely" manner. Absent an opm defini- 
tion of "timely," agencies may wish to include in their regulations a 
more specific definition of what "tmiely" means. 

3. Of the three Defense agencies ^^e reviewed, only the Navy did not 
specify a time period as to when appraisals should be completed. We 
have since learned from a Navy official that a nev/ performance 
appraisal system plan is being developed that will require employees to 
receive their appraisals within 30 days after the end of the appraisal 
period. 

4. As part of our audit work, we examined agencies' policies for con- 
ducting evaluations of their performance appraisal functions and the 
results of the evaluations, where applicable. We did not assess the 
means by which the evaluations were performed. Thus, we do not know 
why the Navy evaluations did not disclose any of the deficiencies we 
found. 
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Note GAO comments 
supplementing those in the 
report text appear at the 
end of this appendix. 



Office of the 
Administrator 
of Veterans Affairs 




Washington DC 20420 



AC\ Veterans 
Vw Administration 




Assistant Comptroller General 
Human Resources Division 
U.S. General Accounting Office 
Washington, DC 20548 

Dear Mr. Fogel: 

Your March 2, 1987, draft report BLUE-COLLAR WORKERS; Appraisal Systems 
Are in Place but Basic Refinements Are Needed has been reviewed. This 
report states that the Veterans Administration (VA), as well as other 
agencies the General Accounting Office (GAO) reviewed, has regulations 
prescribing local-level self-evaluations of its appraisal system. 
However, GAO states only higher level offices were performing these 
evaluations and not as frequently as is desirable. The GAO concluded 
that improvements are needed in the quality of standards and in the 
timeliness with which employees are informed of their performance 
expectations and given their performance feedback. 

We concur in the recommendation that I ensure that local activities 
conduct evaluations of performance appraisal systems and correct 
deficiencies . The evaluations should pay particular attention to the 
types of deficiencies GAO found. More detailed comments on the report 
and actions accomplished or planned to implement the recommendation 
appear in the enclosure. 




THOMAS K. TURNAGE 
Administrator 



Enclosure 
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ENCLOSURE 



Discussed on p. 23. 

See comment 1 . 
Discussed on p. 23. 

Discussed on p. 23. 



VETERANS A^IINISTRATION CCM^NTS ON THE 
MARCH 2, 1987, GAO DRAFT REPORT BLUE-COLLAR WORKERS; 
APPRAISAL SYSTEMS ARE IN PLACE BUT BASIC REFINEMENTS ARE NEEDED 



The Veterans Adniinistration was aware of a number of the problems cited in the 
GAO report and has taken the following steps to improve the quality of 
performance standards for all Agency employees: 

-- The Chief of Staff has sent a message to key officials 
concerning performance management. 

A training module for supervisors on writing better performance 
standards has been developed. 

— A 2 1/2-day course on performance management for Agency 
personnel specialists was presented in 1986 and is scheduled 
again for July 1987. 

The performance appraisal policy covering employees who are not 
in the Performance Management and Recognition System was 
recently revised and will be implemented in April 1987. This 
policy requires development of performance standards only at 
the fully successful level of performance. This will simplify 
the appraisal process and should ultimately contribute to the 
development of better performance standards. 

Although we believe the GAO report overlooks some of the practical problems 
inherent in the development of standards, particularly those for Federal Wage 
System employees, we agree that local personnel offices are in the best 
position to conduct meaningful performance appraisal system reviews. The 
Manual MP-S, Part I, Chapter 27S, Program Evaluation , establishes policy and 
procedures for personnel program evaluation and assigns responsibility for 
personnel management to field station directors. We believe this is a sound 
framework for implementing the GAO recommendation. 

Appropriate steps will be taken to emphasize the local facilities' 
responsibilities for reviewing and evaluating their performance ?ppraisc.l 
practices and procedures. The conduct of local personnel management 
evaluations (PJlE's) will continue to be reviewed in Agency-level P^IE's. We 
will also continue to emphasize the importance of performance standards in our 
Performance Management Training Course. 
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The following are gag's comments on the Veterans Administration's 
letter dated March 31, 1987. 



GAO Comments ^* discussed on page 18 of the report, we agree that the process of 

evaluating employee performance, including the development of stan- 
dards, is difficult, but improvements are possible. 
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Note' GAO comments 
supplementing those in the 
report text uppsar at the 
end of this appendix. 




UNITED States 
OFFICE OF PERSONNEL MANAGEMENT 



WASHINGTON DC 2CW>S 



APR -61987 



Mr. Charles A. Bowsher 
Comptroller General 

United States General Accounting Office 
Washington, D. C. 20548 

Dear Mr, Bowsher: 

Thank you for the opportunity to comment on the draft report 
Blue-Collar Workers; Appraisal Systems Are In Place But 
Basic Refinements Are Needed ^ The report appears to be a 
thorough and comprehensive examination of the implementation 
of performance appraisal systems for Federal Wage System 
employees in the sites you visited. We are particularly 
pleased that you examined the systems with respect to their 
compliance with two of 0PM 's key guidance documents: 
Chapter 430 of the Federal Personnel Manual and The 
Diagnostic Guide for Improving the Quality~ of Performance 
Elements and Standards . 

We believe that the problei.iS you discovered regarding 
quality of standards, timely communication with employees 
about performance expectations, mid-terra progress reviews, 
and communication of performance appraisals are significant 
ones. We fully support your proposed recommendation that 
the Secretaries of Air Force, Array, and Navy and the 
Administrator of Veterans Affairs ensure that local 
activities conduct evaluations of performance appraisal 
systems and correct deficiencies. While centralized 
leadership from 0PM and the headquarters of agencies is 
essential to effective performance appraisal, it is only at 
the local levels, where supervisors and their employees 
interact daily, that changes can be made. 

Since your review was undertaken between March and December 
of 1985, 0PM and the agencies have undertaken several major 
efforts which should contribute to correcting the problems 
you noted. In January 1986, we distributed to heads of 
agencies and directors of personnel copies of several 0PM- 
produced booklets, two of which are directly relevant to the 
problems of developing adequate standards and communicating 
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Discussed on pp. 22-24. 

Now on p. 18. 
Discussed on p, 18. 



See comment 1. 



with employees. Those booklets, Developing and Evaluating 
Elements and Standards; An Information Guide for Managers 
and The Pertormance Interview are written in layman's terms, 
easily understandable and useful to supervisors of Wage 
System employees. These have received widespread use and we 
plan to reprint them and make them available through the GPO 
rider system. 

Since your field work was completed 0PM has published 
revised performance management regulations and developed new 
performance appraisal plans based on those regulations. The 
revised regulations were published on March 11, 1986, and, 
by the end of the 1986 fiscal year over 90% of agencies had' 
OPM-approved plans covering Federal Wage System employees. 
The regulations and plans call for greater employee 
participation in developing elements and standards, provide 
for the communication of written performance plans to 
employees at the beginning of each appraisal period, and 
require that written ratings be given to -employees as soon 
as possible after the end of the appraisal period. 



We wish to clarify one statement in the 
page 25, you indicate that 0PM officials 
September of 1986, that no action had be 
implement the recommendations of OPM's A 
Evaluation Division's August 1985 report 
of action was initiated in i-esponse to t 
we considered that the actions described 
distribution of booklets on performance 
interviews/ the revi sed regulations , and 
approval of new performance appraisal pi 
Wage System employees adequately met the 
that report. 



draft report. On 
informed you, in 
en taken to 
nalysis and 

No specific plan 
hat report because 

above f e.g . , the 
standards and 

the development and 
ans covering Federal 
needs ident if ied in 



We appreciate this opportunity to comment on the draft 
report. 

Sincerely , 




Constance Horner 
Director 
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The following are gag's comments on the Office of Personnel Manage- 
ment's letter dated April 6, 1987. 



GAO Comments ^ • Relieve that OPM's initiative in issuing guidance booklets, pub- 

lishing revised performance management regulations, and developing 
new performance appraisal system plans provides a framework within 
which improvements— particularly in the development of performance 
standards — can be made. However, as the agency responsible for over- 
sight of govemmentwide performance appraisal activities, opm is also 
responsible for ensuring that the agencies have taken steps to address 
the specific problems identified in the opm report. 
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Requests for copies of gao reports should be sent to: 

U.S. General Accounting Office 
Post Office Box 6015 
Gaithersburg, Maryland 20877 

Telephone 202-275-6241 

The first five copies of each report are free. Additional copies are 
$2.00 each. 

There is a 25% discount on orders for 100 or more copies mailed to a 
single address. 

Orders must be prepaid by cash or by check or money order made out to 
the Superintendent of Documents. 



